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Abstract 


'N  The  comeigonce  of  subspacc  iteration  for  the  solution  of  eigenpairs 
is  studied.  The  theoretical  convergence  rate  is  derived  and  is  pre- 
sented with  emphasis  0!i  the  theory  in  the  light  of  practical  implica- 
tions. Various  techniques  to  accelerate  the  convergence  of  the  sub- 
spaee  iterations  arc  proposed  and  arc  tested  in  a pi  eliniinar^' 
manner  on  some  uemonstrativo  sample  problems. 

, , , , y-  '/t- ' ■ '?  , 

1.  Introduction  ^ — / — - - . - ■ 

During  recent  years  the  development  of  solution  techniques  for  cal- 
culating tlio  eigensystem  of  large  cigcnproblcms  has  altraclcd  an 
increasing  amount  of  attention  [1  -3],  A particularly  important 
eigenproblcra  encountered  in  computational  mechauies  is  the  calcu- 
lation of  some  cigcnpair.s  of  the  generali/.ed  cigenproblem 


// 


Kcp  = XMcp  , 


(1) 


[I 


PPG  O 


where  K and  M are  the  .stiffness  and  mass  matrices  of  the  discrete 
degree  of  freedom  system,  and  is  the  i'th  cigenpair.  if  the 

order  of  K and  M is  n,  we  have  n eigenpairs  which  v a order  as 
follows. 


•••  ''Bn 


(2) 


Tnus,  the  solution  for  p eigenvalues  and  corresponding  eigenvectors 
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(3) 

where  the  columns  of  $ store  the  eigenvectors  and  A is  a diagonal 
matrix  with  the  eigenvalues  on  the  diagonal. 

Among  the  techniques  for  calculating  the  lowest  eigenvalues  and 
corresponding  eigenvectors  of  Eq.  (1),  the  subspace  iteration  method 
has  foimd  increasing  use  [1,4-6].  The  subspace  iteration  method 
has  been  applied  successfully  to  the  solution  of  a large  number  of 
problems  and  Table  1 summarizes  some  typical  solution  times.  In 
previous  publications,  the  basic  equations  of  the  methcxl  have  been 
presented,  and  the  practical  implementation  was  discussed  [4,  7], 
but  no  detailed  discussion  of  the  convergence  of  the  subspace  itera- 
tion method  was  given.  However,  for  the  practical  use  of  the  tech- 
nique and  in  the  search  for  methods  to  increase  the  effectiveness  of 
the  basic  algorithm,  it  is  important  to  have  sufficient  insight  into  the 
convergence  characteristics. 


Table  1 Solution  Times  Using  Subspace  Iteration  Method 


Maximum  Number 

half  of  Com-  Central 

System  band-  Mass  eigen-  putcr  proces- 

Systom  order  width  matrix  pairs  used  sor  sec. 
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Convert-yiice  of  i^ubspacc  Itovation 

The  objective  of  this  paper  is  to  discuss  in  detail  the  conver- 
gence properties  of  the  subspace  iteration  method  with  specific  em- 
phasis on  presenting  the  theory  in  the  light  of  practical  implications. 
First,  in  the  paper,  the  basic  equations  that  are  solved  in  sub- 
space iteration  are  briefly  summarized,  and  the  importance  of  each 
equation  solved  is  explained.  Emphasis  is  placed  to  show  in  detail 
how  the  miniml/atiou  of  the  Rayleigh  quotient  is  used  to  extract  the 
best  eigenvalue  £Uid  eigenvector  approximations  from  the  current 
subspace.  In  the  next  part  of  the  paper  the  proof  for  the  ultimate 
convergence  rate  is  given,  and  relevant  practical  consequences  are 
discussed.  A particularly  important  phase  of  the  subspace  iteration 
method  is  the  selection  of  an  effective  starting  subspacc.  In  the  pa- 
per, the  starting  subspace  that  has  been  found  effective  is  described 
in  detail  together  with  various  recent  experiences  gathered.  Also, 
a number  of  tcclmiques  to  accelerate  the  convergence  of  the  subspace 
iterations  are  proposed. 

2.  The  Subspacc  Iteration  Method 

Assume  in  the  following  that  the  order  of  the  matrices  K and  M in 
Eq.  (1)  is  n and  that  we  require  the  lowest  p eigenvalues  and  corre- 
sponding eigenvectors.  The  subspace  iteration  solution  consists  of 
the  following  three  steps: 

(1)  Establish  q starting  iteration  vectors,  q > p,  which  span 
the  starting  subspacc  Ej^. 

(2)  Perform  subspacc  iterations,  in  which  simult.ancous  in- 
verse iteration  is  used  on  the  q vectors,  and  Ritz  analysis 
is  employed  to  extract  optimum  eigenvalue  and  eigenvector 
approximaf  jns  at  the  end  of  each  inverse  iteration. 

(3)  After  iteration  convergence,  use  the  Sturm  scxjuencc  check 
to  verify  that  the  required  eigenvalues  and  corresponding 
eigenvectors  have  been  calculated. 
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The  verification  of  the  solution  results  in  step  (3)  is  straight- 
forward and  is  discussed  in  detail  in  [7],  'Hie  effectiveness  of  the 
algorithm  lies  in  the  procedures  used  in  steps  (1)  and  (2). 

Assume  that  we  have  established  the  q starting  iteration  vectors, 
in  X^,  then  the  subspace  iteration  in  (2)  is  as  follows: 

For  k = 1,  2, . . . , iterate  from  subspace  to  subspace 


Calculate  the  projections  of  the  matrices  K and  M onto 


KkH  - 


(1) 

(5) 

(fi) 


Solve  for  the  cigensystem  of  the  projected  matrices: 

Calcuhite  an  improved  approximation  to  the  eigenvectors: 


-ka 


^ka^kM  • 


(8) 


Tlien,  pi’ovidcd  that  tlio  iteration  vectors  in  Xj^  are  not  orthogonal  to 
one  of  the  required  eigenvectors  (and  assuming  an  appropriate  order- 
ing of  the  vectors),  wc  have 


^•1  ■’ 


X|,|^j  -•$  as  k -•®  . 


The  essential  ingredients  of  the  subspace  iteration  above  are 
the  sinvuUaneous  vector  inverse  iteration  in  Eq.  (1)  and  the  use  of 
the  Uayleigh  minimum  principle  in  Eqs.  (5)  to  (8).  Since  inverse 
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Iteration  is  used,  subspace  iteration  is  closely  related  to  the  QH 
method  [7,  p.  470],  but  subspace  iteration  displays  much  better 
convergence  characteristics  because  the  Rayleigh  minimum  princi- 
ple is  employed  to  extract  in  each  iteration  the  "best"  eigenvalue 
and  vector  approximations.  The  use  of  the  principle  of  minimizing 
the  Rayleigh  quotient  of  an  iteration  vector  lias  also  been  explored 
by  Fried  [8],  Falk  [9],  and  Schwarz  [3].  However,  the  effective- 
ness of  subspace  iteration  derives  from  the  fact  that  the  iteration  is 
performed  with  q vectors,  where  q > p,  which  arc  used  simultane- 
0USI3'  in  the  minimization  of  the  Rayleigh  quotient. 

Considering  the  convergence  of  subspacc  iteration,  two  distinct 
features  are  observed,  which  arc  both  important  in  practical  analy- 
sis; namelj',  the  minimization  of  tlie  Rayleigh  quotient  that  yields 
best  approximations  to  the  required  eigenpairs  in  the  current  sub- 
space  and  the  uUimate  convergence  rate  of  the  iterates.  We  discuss 
both  aspects  in  the  following  sections. 

3^ Minimization  of  Rayleigh  Quotient  in  Subspacc  Iteration 

Tlic  Rayleigh  minimum  principle  states  that 

Xj  = min  p{<£)  , (9) 

where  the  minimum  is  talcen  over  all  possible,  vectors  <p,  and 

T 

tp  Ktp 

Assuming  that  K and  M arc  positive  definite  matrices,  or  that  M is 
positive  semi-definite  in  case  M is  a diagonal  matrix,  we  have 

0<Xj<p(9)<Xj^<“  . (11) 
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In  the  k'th  subspace  iteration  we  solve  for  the  vectors  x, , x„, . . . , 
which  are  stored  in  and  use  the  Rayleigh  minimum  principle 

as  a mechanism  to  generate  "best"  eigenvalue  and  vector  approxima- 
tions. The  fact  that  indeed  the  Rayleigh  minimum  principle  is  used 
can  be  demonstrated  by  defining  a typical  vector  ip  in  the  subspace 


i^l 


(12) 


Then  substituting  ^ into  Eq,  (10)  and  using  the  conditions  3p(^)/dyj  = 0, 
i "1, . . • ,q,  whicli  must  bo  satisfied  at  the  minimum  of  PC^,  we 
obtain  the  eigonproblem 


Ky  = pMy 


(13) 


whore  the  elements  (i,  j)  of  K and  M arc  and  x?  respec- 

tively. The  solution  to  Eq.  (13)  can  be  written 


KY  = MYp  , 


(M) 


where  the  matrix  Y stores  the  eigenvectors  of  Kq.  (13)  and  p is  a 
diagonal  matrix  storing  the  corresponding  eigiMivalues,  p - diag  (Pj). 
Tlie  elements  Pj  are  the  approximations  to  tlic  required  eigenvalues 
of  Eq.  (1)  calculated  using  the  Rayleigh  minimum  principle  and  the 
corresponding  eigenvector  approximations  are 


v-E 
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yij^i 


j = l,2,...,q 


(15) 
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where  y..  is  element  (i,i)  of  Y.  On  comparing  now  Eqs.  (13)  to  (15) 
with  Kqs.  (5)  to  (8),  it  is  realized  that  in  the.  k'lh  subspace  iteration 
the  same  cigenproblem  as  in  the  minimization  of  the  Rayleigh  quo- 
tient is  solved;  i.e, , Eq.  (7)  and  Eq.  (14)  arc  the  same  equations, 
and  that  also  the  same  eigenvector  approximations  are  calculated. 

Using  the  fact  that  the  Rayleigh  minimum  principle  is  employed 
to  evaluate  in  each  sub.spacc  iteration  the  new  eigenvalue  and  vector 
approximations,  it  follows  that  in  the  k'th  subspacc  iteration. 


X <; 

q q 


(IG) 


and,  in  particular,  it  is  possible  to  show  the  actual  mechanism  used 
to  calculate  the  values  x|''"  The  condition  that  X^  < follows 

from  Eq,  (9),  because  the  subspace  contained  in  the  n -di- 

mensional space  in  which  K and  M are  defined. 

The  inherent  procedure  employed  to  evaluate  demon- 

strates the  mechanism  used  to  evaluate  the  approximations  to  the 
higher  eigenvalues.  First  we  observe  that  as  an  extension  of  the 
Rayleigh  minimum  principle,  the  mininiax  characterization  of 
eigenvalues  gives  [7], 


X2  = min  pif)  , 


(17) 


where  the  mii.imum  is  taken  over  all  <p  subject  to  the  restriction 
= 0 . (18) 


However,  in  the  subspace  iteration  we  have  using  the  notation  of  Eq. 

(12), 


(19) 
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where  is  the  Kronecker  delta.  Hence, 
= min  p(§)  , 


w'here  the  minimum  is  taken  over  all  possible  vectors  ^ defined  in 
Bq.  (12)  that  satisfy  the  orthogonality  condition 

= 0 . (21) 

To  prove  that  we  ccnsider  the  auxiliary  problem  of 

evaluating  ^ where 

= min  p{i0  (22) 

subject  to  the  co  dition 


However,  since  ^ ^ \ beeaiisc  is  contained  in  the  space 

spanned  by  <p^, . . . ,<p^,  and  also  A^^  ' < A^^^\  because  the  restric- 

tion in  Eq.  (21)  is  the  most  severe  one,  we  conclude  that 

In  analogy  to  the  conclusion  reached  oti  the  calculation  of 

we  can  conclude  that  in  the  subspace  iteration,  we  evaluate 

- min  p(^  (24) 
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indicates  that  in  the  subspace  iteration  the  higher  eigenvalues  and 
corresponding  eigenvectors  are,  in  general,  calculated  with  less 
accuracy  than  the  lower  eigenpairs,  for  which  less  constraints  arc 
imposed.  This  fact  is  also  observed  in  practical  eigemsolutions. 
Another  important  deduction  can  also  bo  made  from  the  above 
results,  namely  that  the  required  eigenvalues  and  eigenvectors  arc 
calculated  immedi.ately  if  contains  the  subspace  corresponding 
to  (p^, . , . ,(Pp,  hi  other  words,  if  linear  combinations  of  the  vectors 
in  Xj.  can  yield  the  required  eigenvectors,  then  these  eigenvectors 
are  calculated  using  Kqs.  (5)  to  (S). 

4,  Convergence  Analysis 

In  the  previous  section  we  discussed  the  mechanism  that  is  used  to 
establish  optimum  approximations  to  the  required  eigenvalues  and 
eigenvectors  in  a specific  subspace,  and  we  also  deduced  that  if  the 
subspacc  converged,  the  eigenvalues  and  vectors  calcul.atcd  arc 
those  required.  However,  we  did  not  discuss  the  convergence  of  the 
vector  iterates  to  the  required  subspacc  and  the  ultimate  rate  of 
convergence. 

Following  the  work  of  llutisliauser  [10],  the  convergence  of  the 
subsp.acc  iterations  is  conveniently  studied  by  first  changing  basis 
from  the  finite  element  coordinate  basis  to  the  basis  of  eigenvectors 
[7,  p,  425].  This  change  of  basis  is  achieved  using  the  following 
relation  for  the  vectors  Xj^  in  Eq.  (4), 

?k  " . (26) 

where  is  the  matrix  storing  all  eigenvectors,  ^ = [(p^, . . . ,0^^]. 
Since  <I>  is  nonsingular,  there  is  a unique  for  any  Xj^,  and  vice 
versa. 

Introducing  the  relation  of  Eq.  (2G)  into  Eq.  (4)  and  prcmultiply- 
T 

ing  by  $ we  obtain  for  the  first  equation  that  is  solved  in  .subspace 
iteration, 


I 

i 
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(27) 


and  then  equations  equivalent  to  Kqs.  (5)  to  (8),  but  wluch  express 
the  relations  in  the  new  basis,  are  used  to  evaluate  The  con- 

vergence rate  of  the  iteration  is  established  from  Eq.  (27)  and  using 
the  fact  that  in  the  subspace  iterations  always  the  optimum  approxi- 
mations to  the  required  eigenvalues  and  eigenvectors  are  calculated. 

For  the  convergence  anal3’sis  let  the  iteration  matrix  Zj^  be 
denoted  as  follows, 
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where  Z|^  is  completely  general,  because  the  unit  qxq  matrix  can 
always  be  obtained  by  linearly  combining  columns,  provided  Zj^  is 
not  deficient  in  the  vectors  e.,  i = 1, . . .,q.  Using  Eq.  (27)  we  then 
obtain, 
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iteration  vectors  arc  used  tliat  span  the  least  dominant  p-dimensional 
subspace  of  K and  M,  the  subspace  iteration  in  Eqs.  (4)  to  (8)  calcu- 
lates in  the  first  iteration  the  required  vectors  (p^, . , , The  aim 

in  the  selection  of  the  starting  iteration  vectors  is,  therefore,  to 
obtain  vectors  that  as  closely  as  possible  span  the  least  dominant 
subspace  of  K and  M. 

Two  cases  for  which  the  starting  vectors  can  be  chosen  to  span 
exactly  the  least  dominant  subspaco  of  K and  M are,  firstly,  when 
the  mass  matrix  is  a diagonal  matrix  with  only  q nonzero  masses 
and,  secondly,  when  K and  M are  both  diagonal  matrices. 

In  the  case  of  a diagonal  mass  matrix  with  only  q nonzero  diag- 
onal mass  elements,  the  first  subspace  iteration  yields 


K K 

M 0 
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The  projections  of  K and  M arc 


K = F^M 
-2  -a  — 


and 


M.  = f’^MF  . 
—2  -a  — a 


(33) 


(34) 


(35) 


(36) 


i 

i 

i 
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The  eigenproblem  corresponding  to  the  projected  matrices  is  thus 
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Now  substituting  F = F M,  where  F ^ and  K is  the  stiffness 

“ci”“  “*3.  “ii  "“<1 

matrix  obtained  by  statically  condensing  out  In  K alt  zero  mass  de- 
grees of  freedom,  wo  realize  that  Eq,  (37)  can  be  rewrittcu  as 

K^x  = . (38) 

But  Eq.  (38)  is  the  eigcnproblem  from  which  all  finite  eigenvalues  of 
Eq.  (1)  are  evaluated.  Hence,  we  obtain  in  the  first  subspace  itera- 
tion the  lowest  q finite  eigenvalues  and  corresponding  eigenvectors. 

In  the  second  case,  when  K and  M arc  both  diagonal  matrices, 
which  is  really  a trivial  ease,  the  unit  entries  in  the  unit  starting 
iteration  vectors  arc  chosen  to  correspond  to  the  smallest  values  of 
kii/niii.  Thus,  the  unit  starting  vectors  arc  already  multiples  of 
the  reejuired  eigenvectors  and  the  values  !<^/m.J  are  the  correspond- 
ing required  eigenvalues. 

In  practice,  the  specific  matrices  assumed  above  are  hardly  en- 
countered, but  the  results  concerning  the  construction  of  the  starting 
iteration  vectors  indicate,  how  in  general  analysis  effective  start- 
ing vectors  can  be  established.  The  fundamental  observation  is  that 
in  both  cases  above  the  degrees  of  freedom  with  the  smallest  ratios 
k.j/m.^  are  excited,  and  because  the  mass  of  the  system  was  already 
lumped  to  a sufficient  extent,  convergence  is  obtained  in  one  sub- 
space iteration.  If  mass  is  not  lumped  to  the  extent  used  in  the  two 
cases  above,  iteration  is  required,  but  the  starting  vectors  should 
still  be  unit  vectors  with  their  entries  corresponding  to  the  degrees 
of  freedom  with  the  smallest  values  k-j/m^j.  The  actual  scheme 
proposed  in[-l],  which  has  been  employed  extensively,  uses  as  the 
first  column  in  the  diagonal  of  the  mass  matrix  M,  and  as  the 
next  columns  unit  vectors  with  their  entries  i-l  corresponding  to  the 
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smallest  ratios  k../nr..  The  first  full  column  is  used  in  order  to 
excite  all  mass  degrees  of  freedom.  Since  we  are  iterating  with  q 
vectors,  ^ > p,  when  we  want  to  converge  to  p vectors,  the  (q  - 1) 
unit  vectors  would  assure  convergence  in  one  subspace  iteration  if 
one  of  the  two  special  cases  above  is  considered. 

It  has  been  claimed  that  starting  iteration  vectors  with  random 
numbers  are  sufficiently  effective  [10, 11].  Based  on  the  above  ob- 
servations, and  some  numerical  experiments,  it  is  believed  tliat  in 
most  cases  the  above  starting  subspace  is  considerably  more  effec- 
tive than  the  use  of  random  numbers  in  tlic  starting  vectors.  But  to 
improve  the  solution  characteristics  it  is  recommended  that  tlie  ij'tli 
iteration  vector  be  a random  vector  and  bo  generated  new  in  each 
iteration. 

In  addition  to  considering  the  degrees  of  freedom  corresponding 

to  the  smallest  values  k../m,.,  it  appi'ars  that  an  additional  impor- 
1111  2 

tant  consideration  can  be  derived  from  the  values  k../(k., k..). 

2 M )) 

Physically,  the  magnitude  of  the  value  k„/(k..k^^)  is  a measure  of 
the  coupling  between  the  degrees  of  freedom  i and  j.  However,  if 
this  coupling  is  high,  it  is  probably  not  effective  to  excite  both  de- 
grees of  freedom  i and  j in  the  starting  iteration  vectors,  because 
"stiff"  relative  displacements  arc  only  activated  in  the  higher  modes. 

6.  Acceleration  of  Convergence 

In  the  solution  of  some  problems,  notably  those  with  high  mass  lump- 
ing, only  a few  subspace  iterations,  say  C to  8,  are  required  for 
convergence  to  6 digit  precision  on  the  eigenvalues.  However,  when 
systems  with  a continuous  mass  distribution  are  considered,  such  as 
dams,  a large  number  of  iterations  may  be  required.  In  such  cases, 
schemes  to  accelerate  the  convergence  are  very  desirable. 
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li.  1 Shifting 

One  way  to  accelerate  convergence  Is  to  impose  a shift  M onto  the 
matrix  K,  i.e. , to  iterate  on  the  matrix  K rather  than  on  K.  In 
order  to  preserve  stability  and  convergence  to  the  required  lowest 
eigenvalues  and  eigenvectors  it  is  necessary  to  choose  the  shift 
judiciously.  A conservative  value  for  H is  n < \ and  in  practice 
wc  may  choose  M = 0.  However,  it  then  follows  that  /i  can  only 

be  chosen  once  X has  been  approximated  to  a sufficient  accuracy 
(say,  to  three  digits),  which  means  that  the  shift  will  be  imposed  af- 
ter the  first  few  subspace  iterations.  The  new  rate  of  convergence  of 
the  i'th  iteration  vector  to  the  i'th  eigenvector  is  then  (\"M)/(Xq,^^-/i). 
It  is  noted  that  this  shifting  wilt,  therefore,  greatly  increase  the  rate 
of  convergence  to  the  lower  eigenvalues,  but  if  q is  largo  the  rate  of 
convergence  to  the  higher  eigenvalues  of  the  required  spectrum  may 
only  be  marginally  increased. 

Together  with  imposing  a shift  Chebyshev  polynomials  may  also 
be  employed  in  the  iteration  vectors  to  accelerate  the  convergence 
[10][12].  Although  some  experience  has  been  obtained,  the  overall 
effectiveness  of  using  Chebyshev  polynomials  in  the  cigensolution  of 
large  systems  has  not  been  established  as  yet. 

For  small  banded  systems,  the  determinant  search  algorithm 
presented  in  [7]  has  proven  to  bo  efficient,  and  it  appears  that  de- 
pemding  on  the  bandwidth  of  the  system  the  shifting  strategies  used 
in  that  technique  could  be  very  effective  in  subspace  iterations. 
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0.2  Use  of  Aitki  n's  aeceleration  process 

Assume  that  we  havc  calculated  ^2’  using  Aitkon's 

acceleration  technique,  improved  iteration  vectors  for  ob- 

tained by  calculating [13] 
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(41) 


But  then  using  Eq.  (40)  we  conclude  that  W should  be  selected  such 
that 


Vi,j  ° ’ 

which  gives 


1 = l,...,n-q 
j-l,..*,q  • 


(42) 


w = 


(«> 


Hence,  it  appears  that  a different  to  should  be  employed  for  each  iter- 
ation vector  j = 1, . . . ,q.  Although  we  could,  based  on  the  current 
eigenvalue  approximations,  at  best  estimate  appropriate  to-values 
for  the  iteration  vectors,  Eq.  (43)  shows  that  to  should  be  larger 
than  one. 


7.  Some  Numerical  Solutions 

To  study  in  a preliminary  manner  the  convergence  characteristics 
of  the  subspace  iteration  method  with  and  without  the  acceleration 
schemes  discussed  above,  the  solution  of  a few  elgcnproblems  was 
considered.  The  immediate  aim  was  to  Identify  whether  the  acceler- 
ation schemes  would  indeed  be  reducing  the  number  of  iterations 
considerably.  The  next  step  of  this  work  will  be  to  optimize  the 
acceleration  schemes  and  develop  an  improved  subspace  iteration 
method. 

Figure  1 summarizes  the  discrete  systems  that  have  been  anal- 
yzed in  this  study  using  the  subspacc  Iteration  method,  and  gives  the 
size  and  order  of  the  corresponding  stiffness  and  mass  matrices. 
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^“VvA/ — WV — — WV- — AAA* ^ 

^12  24  25  59  60  ^ 


EXAMPLE  I ANALYSIS  OF  60  ELEMENT  UNIFORM 
SPRING  MODEL 


(-2L--H^2L  ^-2L-H 


E = 30000,  1=0.0833 
L=  10,  A = I, 

/)=  0.000104 


EXAMPLE  2 ANALYSIS  OF  10  STOREY  AND  3 BAY 
FRAME  ON  SPRING  SUPPORTS 

Flgiire  1.  Sample  analyses. 


These  problems  have  been  selected  because  a relatively  large  num- 
ber of  Iterations  are  required  for  solution  of  the  required  elgen- 
palrs. 

Tables  2 and  3 summarize  the  results  obtained  In  the  analyses. 
Convergence  in  the  iterations  was  measured  by  [7,  p.  504] 
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Table  2.  Analysis  of  Spring  Model:  k = 375;  m=0. 00013;  consis- 
tent mass,  tol=  10“^ 


Case 

no 

acceleration 

with  over- 
relaxation 

with  shifting 
toM 

(Sect.  6.1) 

with  .Xitken's 
acceleration 

number  of 
eigenpalrs 

2 

8 

22 

22 

2 

22 

22 

number  of 

iteration 

vectors 

4 

16 

30 

30 

4 

30 

30 

number  of 
iterations 

7 

10 

25 

20 

6 

25 

26 

Tables.  Analysis  of  Frame  Model:  - 10^;  kj^  - 10^;  lumped 

mass,  tol  = lO""^ 


Case 

no 

acceleration 

with  over- 
relaxation 

with  shifting 
to  M 

(Sect.  6.1) 

with  Aitken's 
acceleration 

number  of 
eigenpalrs 

2 

8 

22 

2 8 22 

2 

22 

2 

number  of 

iteration 

vectors 

4 

16 

30 

4 16  30 

4 

30 

4 

number  of 
iterations 

25 

14 

18 

16  12  20 

11 

18 

25 

(k) 

where  is  the  approximation  to  Xj  calculated  in  the  k'th  subspace 
Iteration.  The  results  in  the  tables  display  the  following  solution 
features. 
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Using  the  over  relaxation  scheme  with  an  arbitrarily  picked 
value  W = 1.  G for  all  iteration  vectors  the  number  of  iterations  i-e- 
qiiired  for  convergence  was  reduced  in  almost  all  cases. 

Considering  shifting  to  a lower  bound  on  it  is  seen  that  the 
number  of  iterations  required  for  convergence  is  rtxluced  signifi- 
cantly when  only  a small  number  of  eigenpairs  are  sought  but,  as 
expected,  when  relatively  many  eigenpairs  are  to  be  extracted  a 
single  shift  into  the  vicinity  of  the  smallest  eigenvalue  required 
docs  not  result  in  a substantial  decrease  in  the  total  number  of  sub- 
space iterations  nci^dcd. 

Since  shifting  accelerates  the  convergence  to  the  eigenvalues  in 
the  vicinity  of  the  shift,  additional  shifting  to  the  higher  eigenvalues 
should  be  performed,  but  a stable  and  effective  algoritlmi  is  still  to 
be  developed. 

In  these  analyses  the  Aitken  acceleration  did  not  reduce  the  total 
number  of  subspace  iterations  required  for  solution.  In  addition,  it 
was  observed  that  the  process  of  using  Aitken's  acceleration  was 
very  sensitive  to  the  time  at  which  the  acceleration  was  applied.  It 
was  found  that  Aitken's  formula  should  onlj'  be  employed  once  the 
iteration  vectors  converged  linearly,  otherwise  the  application  of  the 
formula  could  result  in  an  increase  of  the  number  of  iterations  needed 
for  the  solution. 

8.  Conclusions 

Based  on  the  theoretical  convergence  study  of  subspacc  iteration 
and  the  few  numerical  experiments  presented  in  this  paper,  it  is 
concluded  that  the  original  subspacc  iteration  method  can,  for  many 
elgensolutlons,  still  be  improved  significantly.  Improvements  in  the 
starting  subspacc  should  be  possible.  Among  the  acceleration  tech- 
niques presented  In  the  paper  the  use  of  ovcrrelaxation  factors  ap- 
pears very  promising.  In  addition,  shifting  strategics  as  employed 
in  the  determinant  search  method  should  be  explored. 
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In  this  paper,  the  use  of  the  subspace  iteration  method  was  only 
considered  for  the  calculation  of  the  smallest  eigenvalues  and  cor- 
responding eigenvectors  but  the  development  of  shifting  strategies 
should  also  lead  to  an  extension  of  the  technique  to  be  able  to  calcu- 
late intermediate  eigenvalues. 
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